Representing and Evaluating Electronic Contracts with Normative Markov Decision Processes
نویسندگان
چکیده
This position paper summarizes the contributions resulting from the short term scientific mission (STSM) of the first author, from University Rey Juan Carlos, to the Kings College London. During this scientific mission, we have studied the impact of norms on the sequential decision making of rational agents, and how they can be modelled and quantitatively assessed. For this purpose, we put forward a framework based on Markov Decision Processes that allows for explicitly representing norms and sanctions. In order to illustrate the usage of the framework, we model an example in a simulated aerospace aftermarket ruled by electronic contracts in terms of norms and sanctions, and present algorithms for reasoning about it.
منابع مشابه
Using Normative Markov Decision Processes for evaluating electronic contracts
Before signing electronic contracts, a rational agent should estimate the expected utilities of these contracts and calculate the violation risks related to them. In order to perform such pre-signing procedures, this agent has to be capable of computing a policy taking into account the norms and sanctions in the contracts. In relation to this, the contribution of this work is threefold. First, ...
متن کاملAccelerated decomposition techniques for large discounted Markov decision processes
Many hierarchical techniques to solve large Markov decision processes (MDPs) are based on the partition of the state space into strongly connected components (SCCs) that can be classified into some levels. In each level, smaller problems named restricted MDPs are solved, and then these partial solutions are combined to obtain the global solution. In this paper, we first propose a novel algorith...
متن کاملThe Advisor-POMDP: A Principled Approach to Trust through Reputation in Electronic Markets
This paper examines approaches to representing uncertainty in reputation systems for electronic markets with the aim of constructing a decision theoretic framework for collecting information about selling agents and making purchase decisions in the context of a social reputation system. A selection of approaches to representing reputation using Dempster-Shafter Theory and Bayesian probability a...
متن کاملReasoning under Uncertainty in Social Reputation Systems: The Advisor-POMDP
This paper examines approaches to representing uncertainty in reputation systems for electronic markets with the aim of constructing a decision theoretic framework for collecting information about selling agents and making purchase decisions in the context of a social reputation system. A selection of approaches to representing reputation using Dempster-Shafter Theory and Bayesian probability a...
متن کاملComplexity Issues in Markov Decision Processes
We survey the complexity of computational problems about Markov decision processes: evaluating policies , nding good and best policies, approximating best policies, and related decision problems.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012